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IMAGE PROCESSING METHOD AND SYSTEM. AND MEDICAL EXAMINATION 
APPARATUS, FOR EXTRACTING A PATH FOLLOWING A THREADLIKE 

STRUCTURE IN AN IMAGE 



FIELD OF THE INVENTION 

The invention relates to an image processing method of extracting the points of a path 
following a threadlike structure represented in an image. The invention more particularly 
relates to an image processing method of extracting the points representing a catheter guide- 
5 wire in an X-ray fluoroscopic medical image or thin vessels in an angiogram. The invention 
also relates to an image processing system and to a medical examination apparatus such as an 
X-ray apparatus having a system and m e an s for image processing. 

The invention is applied to medical imaging systems and to the industry of X-ray 
medical examination apparatus. 

10 

BACKGROUND OF THE INVENTION 

A method to determine an object contour, referred to as minimal path, between two 
fixed end points in a 2-D image, is disclosed in the publication "Global Minimum for Active 
Contour Models-: A minimal Path Approach" by Laurent D. COHEN and Ron KiMMEL, in 

1 5 International Journal of Computer Vision 24(1), 57-78 (1997). This method proposes a 

technique of boundary detection of objects for shape modeling in 2-D images. This method 
particularly aims at solving the boundary detection problem by mapping it into a global 
minimum problem and by determining a path of minimal length from the solution of that 
global minimum problem. The method guarantees that a global minimum of energy is found 

20 by minimizing curves between two end points. This method compri ses implements st e p s a 
step off!) manually selecting a start point and an end point in an object contour region of a 
gradient image s (2) a step of propagating a front, in the totality of said the gradient image, 
starting at the start point, in such manner that this front propagates at lower cost in regions of 
high gradient values until the end point is reached : this det e rmin es to thereby determine a 

25 cost map which that is a totally convex surface having a single minimum-; and {3} a step of 
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back-propagating from the end point towards the start point by the steepest gradient descent 
in said the totally convex surface : this provides to thereby provide a minimal path between 
the start and end points. 

This publication includes by reference a front propagation technique disclosed in a 
5 publication entitled ,T A fast marching level set method for monotonically advancing fronts" 
by J. A. SETHIAN in Proc. Nat. Acad. Sci., USA, Vol. 93, pp. 1591-1595, February 
1996, Applied Mathematics. According to said the reference, a front, formed in a 2-D grid of 
potential values, is propagated using a "Fast Marching Technique" with a determination of 
the front points. The front is a solution of a so-called Eikonal Equation. The Fast Marching 

10 Technique introduces order in the selection of the grid points and sweeps the front ahead in 
one pass on the 2-D image. The Fast Marching Technique compris e s implements a marching 
of the Front outwards by freezing already visited points denoted Alive, coming from a set of 
points referred to as Narrow Band, and by bringing new ones denoted Far Away into said the 
Narrow Band. The Narrow Band grid points are always updated as those having minimal 

15 potential values in a neighboring structure denoted Min-Heap and the potential of the 
neighbors are further re-adjusted. 

The method known from COHEN's publication constructs the convex surface of the 
cost map using said the Fast Marching technique, which provides respectively one path of 
minimal cost joining the start point to each respective point of the front, said the front 

20 propagating until the end point is reached. Then, the minimal path is provided by back- 
propagating from the end point to the start point by the steepest gradient descent in the 
convex surface. The numerous paths constructed by propagating the front forwards and 
joining the start point to the different points of the front for forming the convex surface are 
no longer taken into account. Even the path joining the start point to the end point, in the 

25 operation of forwarding the front, is not the steepest gradient descent in the back-propagation 
operation. 

So, the final path obtained by this known method does compr is e not have p oints 
extracted by tracking. Neither does it compris e have points of a path constructed by front 
propagation. 

30 Besides, it is interesting to note that the points of a path constructed in the operation 

of marching the front forwards are points which have the smallest possible potentials. 
Starting at the start point, and going forwards from one point to the next point must be at the 
"minimal cost". So, such a path is a path of "minimal Action", i.e. a a path on which the 
"Sum" or the "Integral" of potentials calculated over point potentials is the smallest, though 
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strictly continuously growing as a function of the number of points present on sa& the path 
between the start point and the current point on the front. 

A first problem in extracting a threadlike structure is that said the threadlike structure 
may be represented in the original image by a number of thin linear segments which are not 
5 joined in a strictly continuous manner, having "holes" between them, and which are to be 
found among a great number of other thin unrelated structures, referred to as false alarms. A 
second problem is that said the threadlike structure may be very long and sinuous, so that it 
may be far from a straight line and may even present U-turns along its length, and that it may 
be formed by a great number of points. 

1 0 On the one hand, a path constructed using the front propagation technique described 

in the known publication is not adapted to solve these problems, due to the fact that satd the 
front propagation is based on an "Action"^ i.e. a a "Sum" of potentials effectuated along the 
constructed path. Because the threadlike structure is very long, this Sum of potentials will 
soon become very large on a path following saw* the threadlike structure. When sa4d the Sum 

1 5 becomes large, the cost becomes high, and, for minimizing costs, the known front marching 
technique may generate a path based on the nearest false alarms in order to follow as few 
points as possible. So, the known front marching technique may generate a path which is far 
from following the sinuous and long threadlike structure. 

On the other hand, the minimal path obtained by the above described minimal path 

20 method is a smoothed path, which may not possibly provide extracted points strictly 
following a long and sinuous threadlike structure. 

SUMMARY OF THE INVENTION 

The present invention has for an object to provide an automatic image processing 
25 method performed between two predetermined end points for supplying a path strictly 

following a long sinuous threadlike structure. The invention particularly has for its object to 
provide such a method of processing an original image of such a long and sinuous ill- 
represented threadlike structure and of false alarms and to provide extracted points of the 
threadlike structure as a continuous linear structure of points denoted path, suitable for 
30 improving the visualization of safcl the threadlike structure. 

It is also an object of the invention to provide a medical examination apparatus using 
an image processing system to carry out this method and to process medical images. 

Swlvan imag e pr o c e ssing method is - claimed in Claim 1 . And such a medical 
e xamination apparatus is c l aimed in Claim 1 4. 
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Advantages of the method are that it is automatic, robust and reliable^ fit accurately 
and securely follows the long sinuous threadlike structure without looking for a shorter path 
and without providing holes and false alarms^ f-it is less calculation-time consuming than the 
known front marching technique, it may be applied to construct 3-D images from 2-D data 
5 and it is implemented with simple means structural configurations - An advantage of the 

apparatus is that the visualization is improved of thin long structures in a medical image, such 
as a guide-wire in an angiography image for instance, or brain vessels. 

BRIEF DESCRIPTION OF THE DRAWINGS 
10 The invention is described hereafter in detail with reference to diagrammatic figured* 

wherein-: 

FIG. 1 is a functional block diagram illustrating the main steps of the path-tracking 
method-; 

FIG. FIGS. 2A to 2C illustrate the front propagation according to the Filiation Front 
1 5 Marching technique in a grid of points-; 

FIG. 3 is a curve of the weight to be assigned to each potential as a function of a 
number of points along the track determined by the Filiation Front Marching technique from 
the Ancestor or Start Point to the last found Child or current point-; 

FIGS. 4 A and 4B illustrate the calculation of the turning angle at a point of the track 
20 for determining the curvature of the path-; and 

FIG. 5 illustrate an X-ray apparatus having a system for carrying out the method. 

DESCRIPTION OF PREFERRED EMBODIMENTS 

The invention first relates to an image processing method based on a path-tracking 

25 operation performed between two fixed end points for supplying a path strictly following a 
long sinuous threadlike structure represented on a background in a digital image. In 
particular, the invention relates to an image processing method of path-tracking the points 
representing a catheter guide-wire in an X-ray fluoroscopy medical image. In another 
particular application, the invention may relate to the path-tracking of thin brain vessels 

30 which have a threadlike shape. The invention also relates to a system implementing the 

method and to an X-ray medical examination apparatus having such a system and m e ans for 
image processing and image visualization. 

In the first particular case of guide-wire path-tracking, the medical image may be an 
X-ray static arteriogram image representing at least a blood vessel with a guide-wire. In 
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cardiology, such an image may be used to present medical data related to the blood vessel for 
further medical procedures. The medical procedures using catheter deeply rely on the correct 
visibility of the guide-wire which is a metallic wire introduced in the vessel for guiding the 
catheter. An image processing operation of path-tracking this guide-wire in an arteriogram 
5 image, that is the detection and location of the points belonging to said the guide-wire, can 
serve several highly interesting purposes. For example, a binary extraction mask may be 
constructed from the path-tracking operation thus increasing visibility, in order to improve 
the practitioner's ability to determine medical data. After a complete extraction of the guide- 
wire points, the guide-wire tip can be located and an area of interest may be defined around 

1 0 this tip. This enables further local processing for better visibility enhancement of a tool 
called stent introduced in the vessel for its enlargement. In the second particular case, the 
medical image may be an angiogram of the brain where the vessels have been made as visible 
as possible by injection of a contrast fluid into the patient. The brain angiogram contains 
very thin vessels which may be very difficult to visualize. The method according to the 

1 5 invention permits the practitioner to better visualize said the vessels. In both cases, the data 
may alternately be used to construct 3-D images. 

The present path-tracking operation uses a Front Marching technique referred to 
herein as Filiation Front Marching technique denoted FFM, which is not based on a "Sum" or 
an "Integral of potentials" to go from one point to another, as known from the state of the art, 

20 but which instead is based on terms of "Weighted Sums of Potentials". It is to be noted that 
the "Weighted Sums of Potentials" correspond to calculated terms of "Cumulated Costs", 
which may not be growing strictly continuously. This property of strictly continuous 
growing, which exists in the terms of "Sums" or "Integrals" of the Prior Art technique, no 
longer exists in the terms of "Cumulated Costs" of the present path-tracking operation. So, 

25 according to the present Filiation Front Marching technique, the result is that the property of 
relying on the construction of a minimal path no longer exists. Actually, the path tracking 
operation based on said the Filiation Front M arc hing toohniquo FFM technique aims at 
providing a "Best Path which is not bound to be the "Minimal Path". The "Best Path" is 
defined as the path that is validated by using the Filiation Front Marching FFM technique 

30 described hereafter. 

Now, the FFM technique first compris es implements a definition of a function of 
Cumulated Costs associated to each processed point, which is based on the Potentials of the 
processed points and which is especially adapted to path-tracking long sinuous threadlike 
structures. Such a function formed by terms of Cumulated Costs is no longer strictly 
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growing, thus the cost map which may be constructed from these terms of Cumulated Costs 
is no longer exactly convex, and the required path is no longer allowed to be obtained by the 
simple steepest descent from the End point to the Start point. Using this function of 
Cumulated Costs, the Best Path found may not be minimal. Moreover, this Filiation Front 
5 Mar ching t e chniqu e FFM technique is not based on the known Eikonal Equation used in the 
prior art, but, instead, is based on a specific "Distance" for defining a distance relationship 
establishing a direct filiation between consecutive points which belong to a path and which 
are denoted "Father and Child". 

The path-tracking operation using the FFM technique comprises implements an 

10 initializing phase of setting end points for the required Best Path, denoted Start and End 

Points, which are defined in an image of Potentials. Using said the relation of direct filiation, 
in a first processing phase of the technique, the front is marched forwards, starting from the 
Start Point which is referred to as the "Ancestor", until it reaches the End Point which is 
referred to as the "Last Child". Then, in a second processing phase of the technique, the 

15 required Best Path is found by tracking backwards from the Last Child to the Ancestor. 

Referring to FIG.l, which is a functional block diagram illustrating the image 
processing method for path-tracking a threadlike structure based on the Filiation Front 
Marching FFM technique, said the method compris e s : - implements the following operations . 
a» An operation 1 of image data acquisition from an Original Image denoted OI, for 

20 instance a medical image such as a cardiogram including a guide-wire or an angiogram 
including thin vessels to be extracted-; said the image data include digital intensity levels 
referred to as pixel values, and pixel coordinates in the Original Image, f 

an An operation 2 of construction of a contrast image IP in which each pixel of the 
Original Image is associated to a new calculated intensity level which is taken as a Potential; 

25 such an operation may be carried out by any technique known to those skilled in the art for 
enhancing troughs in the Original Image-: for instance, in the cited medical Original Tmage 
OI, the objects of interest, either guide-wire or opacified vessels, are darker than the 
background-; so, the Original Image Ol is first inverted, then the ridgeness is evaluated by a 
filtering operation-: by this filtering operation, for example, the maximum curvature is 

30 calculated at each current point as a differential invariant by passing a Gaussian filter then a 
differential operator, thus providing enhanced ridges in the places of the objects of interest-; 
the filtered image is further again inverted to provide an image referred to as " Image of 
Potentials" which is the contrast image IP, where the objects of interest are again darker than 
the background and form thin troughs substantially contrasting with the background^ t 
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an An initializing phase 3 of setting end points including a Start point A denoted 
Ancestor and an End point B denoted Last Child between which a path following a given 
object of interest, that is the threadlike object, is to be determined in the contrast image IP, f 
a-A first processing phase 4 of path-tracking using the front propagation technique 
5 referred to as F i liation Front Marching the FFM technique, to march a Front forwards from 
the Start Point A to the End Point B-; in said the first processing phase 4, marching the Front 
forwards according to the FFM technique provides First Tracks for the patru ? 

a A^second processing phase 5 of path-tracking also using the F i liation F ront 
Marching technique FFM technique, starting at said the End Point B considered as the last 
10 bom Child and propagating the front backwards thus following one First Track backwards-; 
in order to come down said the First Track, it is necessary and sufficient to follow the 
filiation from Child to Father and Grandfather until the Ancestor which is the Start point A is 
reached-; it is different from going down the steepest gradient descent of the known convex 
cost map-; the required Best Path is obtained in this second processing phase 5 by said the 
1 5 backtracking operation. 

Using the Filiation Front March i ng t e chnique FFM technique* the first processing 
phase 4 of marching the Front forwards has the advantage of not being time consuming 
because the Front is not wide and does not try many solutions. The second processing phase 
5 has the advantage to provide the required Best Path having no holes, including no false 
20 alarms and strictly following the threadlike structure. The description of this Filiation Front 
M arching t echnique FFM technique includes first a description of the front construction 
technique, then a detailed description of the function of terms of Cumulated Costs. 

Referring to FJG.2A to FIG.2C, the Front according to the FFM technique is 
constructed in an iterative manner. FIG.2A to FIG.2C each represents a grid of points in the 
25 Image of Potentials IP constructed in the operation 2 from the Original Image acquired in the 
operation 1 . This Image of Potentials contains the two End Points set in the initializing phase 
3, including the Start Point A and the End Point B. An advantageous specific Distance law to 
be used in this FFM technique is based on the known City Block Distance. Said The 
Distance law permits of propagating, on a path constructed by the FFM technique, only along 
lines or columns of the grid of points, with one grid point interval between two successive 
points referred to as Father and Child. Also, an advantageous Criterion of costs, which will 
be further described, provides a function of Cumulated Costs related to a point of the grid 
called Child, said the Criterion taking into account a function of the Cumulated Costs related 
to the Father of this Child and of the Potential at this Child. 



30 
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Referring to F1G.2A, at a certain stage of the front propagation denoted instant tO, the 
Image of Potentials IP comprises points already visited which are referred to as Frozen 
Points, located in a zone denoted FZ, and which are represented by dots. These Frozen 
Points are not allowed to change state, that is to have the name of their location FZ or their 
5 associated function of Cumulated Costs modified. This is the reason why they are referred to 
as Frozen Points. The already propagated front is a set of points including the Start Point A 
which is the Ancestor and Frozen points forming paths going to the last Frozen Points found 
before the instant tO. This Frozen zone has an outwards boundary referred to as L0FZ. The 
interior of the Frozen zone FZ are points labeled Frozen Points and having only neighbors 
1 0 labeled Frozen Points. 

Besides the Frozen Points, the image of Potentials IP compri se s implements points 
which are situated in a zone denoted NB, adjacent the Frozen zone, referred to as Narrow 
Band whose points are represented by crosses. This Narrow Band surrounds the Frozen zone 
external boundary and has itself a further external boundary denoted L0NO. So, the external 
15 boundary L0FZ of the Frozen zone is a set of points labeled Frozen Points having at least one 
neighbor labeled Narrow Band Point 

The Image of Potentials IP moreover comprises implements points referred to as Far 
Points represented by small squares, located in a zone denoted FAR, which includes all 
points external to the Narrow Band and the Frozen zone. So, the external boundary LONB of 
20 the Narrow Band is a set of points labeled Narrow Band Points having at least one neighbor 
labeled FAR Point. 

According to this FFM technique, an operation of examining a point of the Narrow 
Band, considered a Child, is performed. The Father of this point must be a point of the 
Frozen zone which is a neighbor of the Child and which is such that the function of 
25 Cumulated Costs related to said the Child associated to said the Father is minimal with 
respect of other functions of Cumulated Costs which may be calculated for said the Child 
associated to other possible Fathers. For instance, in the example of FIG.2A, a part of the 
grid of points is examined. This grid part comprises at this given instant tO : 
Points P b P 2 , P 3 » Pe which are in the Frozen zone FZ ; 
30 Points P 9 , P 4 , Ps which are in the Narrow Band NB ; 

Points P 7 , P« which are in the £AR Far zone FAR. 
These points of the grid are examined and, in the example of FrG. 2A, current point P 5 is 
found to present two properties-: It is located in the Narrow Band and its function of 
Cumulated Costs, calculated according to the Criterion which will be further described, is 
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minimal with respect to those of the other points of the Narrow Bajid. The current point P 5 is 
then selected as the Narrow Band point having the minimal function of Cumulated Costs at 
this instant tO. According to this FFM technique, said the current point Ps having such 
properties is decreed a possible Father. 
5 Referring to F1G.2B, at the next instant tl, in the Image of Potential IP, the state of 

this current point P 5 is modified by marching the limit L0FZ of the Frozen zone towards the 
Narrow Band zone so as to include point P 5 in the Frozen zone. Said The limit is now 
referred to as L1FZ. Further on, the point P 5 is a Frozen point having the function of 
Cumulated Costs previously determined and is referred to as a Father. Now, according to 
10 this FFM technique, it is looked for the only Child of this Father. 

Referring to FIG.2C, at the instant t2 following tl, in the image of Potentials IP, the 
neighbors of the Father Point P 5 are examined. According to the Distance law of the FFM 
technique, only adjacent points on lines and columns may be neighbors and, unlike the 
method cited as prior art, the diagonal points are not relevant and are thus not considered. 
1 5 So, according to the Distance law of the FFM technique, in the case i Mustrated by F1G.2C as 
an example, there are four existing neighbors, which are P 8? P 4 , P 6 , P 2 . All neighbors must be 
examined and possibly updated. Their state may be modified, i.e.,, some of them may 
become Children-: 

Neighbors P 6 , P 2 are in FZ_ They remain Frozen Points. 
20 Neighbor P 8 is in FAR. At this instant t2, the limit of the NB zone is marched 

towards the FAR zone so as to include this neighbor P 8 in the Narrow Band zone according 
to a new limit L2NB of the Narrow Band, thus filing the hole created in the Narrow Band at 
the previous instant tl by marching the Frozen Zone limit forwards to reach the location 
L1FZ. The Narrow Band preferably does not remain with a hole. At this instant t2, point P 8 
25 in the Narrow Band becomes a Child whose Father has to be determ ined. 

Still referring to FIG.2C, at the instant t3, the Father and the Cumulated Cost of this 
new Child P 8 are determined. The Father of the Child P 8 must be the neighbor which is 
already located in FZ and which has the smallest related function of Cumulated Costs. Only 
point P 5 answers these conditions because it has been selected as having the smallest function 
30 of Cumulated Costs according to the result of the calculation of the Criterion as explained in 
relation to F1G.2B. So this Frozen Point P 5 may be decreed to be the Father of Child P 8 . 
Now, a new function of Cumulated Costs is to be calculated for this Child P 8 from said the 
further described Criterion, which takes into account the function of Cumulated Cost of the 
Father PS P5 and the Potential at the Child. 
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Neighbor P 4 is in NB. It remains in NB. Until instant t3 this point P 4 of the Narrow 
Band has had a Father and a related function of Cumulated Costs which have been 
determined at a given previous instant. Let this previous function of Cumulated Costs be 
denoted CCi and this previous Father be for example Pi of the Frozen zone FZ. For 
5 searching the Father of this Child P 4 , the points located in the Far zone are not relevant 

points, said the points having infinite costs. Point P 2 is in a diagonal position with respect to 
Child P4, so P 2 is not relevant. Thus, only Pi and P 5 may be possible Fathers. 

At the following instant t4 ? it is investigated whether the point P 5 may be a better 
Father for its neighbor P 4 than the previous Father Pi of said the Child point P 4 of the Narrow 
1 0 Band. To that end, a new function of Cumulated Costs denoted CC 2 is calculated for this 
Child P 4 , taking into account that this point P 5 may be a Father of P 4 . For that purpose, this 
new CC2 takes into account the function of Cumulated Costs related to said the possible 
Father P 5 and the Potential at said the Child P 4 . Then €C4- CO and CC 2 are compared. 

When CC 2 > CC Is it means that it is not interesting to make the required path pass 
15 through possible Father P 5 - So point P 5 is not decreed the Father of P 4 . 

When CC 2 < CC|, it is interesting to make the required path pass through Father P$ 9 
so said the point P 5 may be decreed the new Father of the neighbor P 4 instead of Pi and CC2 
CC? is the new function of Cumulated Cost related to the Child P4 associated to the Father 
P5. 

20 The Criterion giving the function of Cumulated Costs CC k related to a given current 

point Pk is a function of the sum of the minimum among the Cumulated Costs of the 
neighbors of said the current point P^ and the Potential at said the point. According to the 
present Filiation Front Marching t e chnique FFM technique , since the cost related to the 
current point is calculated from the Minimum "Min" of a number of Cumulated Costs 

25 constituted by the Cumulated Costs of its neighbors located at one grid interval on the same 
line or column, the Argument "Arg" of said the minimum "Min" supplies the location of the 
point referred to as "Father" of the current point P k which is the last one to go out of the 
Narrow Band. 

The Father of the current point P k is the last point to go out of the Narrow Band in 
30 order to become a Frozen Point. The next FAR Point becomes a Narrow Band Point. This 
former FAR point had an infinite Cost. It must be attributed a new function of Cumulated 
Cost. The point that is the last one to go out of the Narrow Band gives its function of 
Cumulated Cost to its neighbor FAR Point and becomes its possible Father. 
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The function of Cumulated Cost CC k may preferably be determined by the Criterion 
described hereafter providing a robust and reliable value. This Criterion is described in two 
examples of Techniques referred to as CC k First Calculation Technique and CC K Second 
Calculation Technique, which is a refined version of the First Calculation Technique. 
5 The First Calculation Technique to compute CC k takes into account that the track 

between the Ancestor and the current point must have on average the lowest Potential value. 
So this First Technique involves a Potential Mean Value instead of the Potential Sum or 
Integral known from the State of the Art. According to the Filiation Front Marching 
Technique, the length of the path between the Ancestor and the current point is calculated by 
10 adding 1 each time a Father fathoms a Child. When the Father is located at the above- 
described City Block Distance denoted Distance L k from the Ancestor, the Child P k is located 
at a Distance L k +\ which may be written as L k+1 . So, the Distances between the Ancestor 
and the current points are updated, and the CC k values are further calculated as follows as a 
Potential Mean Value (1) : 



15 cc k =-Lg Q . 



where Q, are the Potentials at the current points located between the Ancestor and point P k . 
The previous relation (1) may be written as: 

<~^k - - — (2) 

Thus, each time a Child is fathomed, the Distance is updated by adding 1, and the new 
20 function of Cumulated Cost is calculated from the previous function of Cumulated Cost, the 
previous Potential and the previous Distance. Unlike the law known from the State of the Art 
where the paths are associated to the smallest ]TQ k , which penalizes the long threadlike 
structures, according to the invention said the paths are associated to the smallest Q k , which 
favors said die long threadlike structures. 
25 Referring to FIG.3, which shows a curve of CQ versus the potential Q k , where k is 

the number of points on the path starting from the Ancestor, it is to be noted that the function 
CC k is weighted by a constant weight having the value 1/L k . Unlike the State of the Art, 
where the £ Q k which is used as weighted by a weight I , according to the invention the 
function CC k is weighted by the term l/L K which depends on length and makes an 
30 advantageous correction of the ftmction evaluation. The Distance L K is the above-described 
City Block Distance. However, it is to be noted that in relation (2) the potential Qk has only a 
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small influence on the CC K value which is a cause of lack of sensitivity to local Potential 
variations. An advantage is that the sensitivity of the path tracking technique is substantially 
independent of the path length. 

According to the invention, in this First Calculation Technique, the function CC fc is 
5 evaluated using first order recursive filters which supply the required Weighted Sum (2). 

A second Calculation Technique is described hereafter for solving said the problem of 
lack of sensitivity. Now, in said the Second Calculation Technique, the function CCk is 
calculated using an average effected of predetermined limited temporal spans defined from 
the current point, which permits, as the path is progressively constructed, to progressively 
10 "forget" the data related to points processed prior to said the temporal spans. So, this 
Technique permits to take Local Events in a given past into account 

For calculating the function CC k , the track is searched first only locally in the best 
possible direction, taking the Local Events into account To that end, only the functions of 
Cumulated Cost related to the points found in a given past are taken into account for 
15 calculating the function CC K > while the functions of Cumulated Cost related to points which 
where found in a longer past are "forgotten \ i.e. a they are not taken into account This is 
obtained using one parameter a which is a weight factor of minimization of the influence of 
points situated farther away than at a given distance from the current point. This weight 
factor is applied to the previously described function of Cumulated Costs, where CC KA is the 
20 function of Cumulated Cost related to the Father and Q K is the Potential at the current point : 
CC K -«CC K . [+ (l-a)Q K (3) 
The a parameter is a constant and fixes the temporal span, and the number of Fathers which 
is taken into account. The span may be approximated by the relation : 

l/(l-cr ) where 0 < a < 1. (4) 
25 If a = G£ 09, the number of Fathers which is taken into account to calculate CC k is about 
10. 

If a = 0^ (L5, the number of Fathers which is taken into account to calculate CC k is about 
20. 

Now, it is not sufficient to take Local Events into account, because the Filiation Front 
30 Marching technique may be deceived and may lose the good track. So Global Events must 
also be taken into account. To that end, the Filiation Front Marching technique takes into 
account the curvature along the First Track in order to avoid zigzags. Jt is known to those 
skilled in the art to calculate the Turning Angle at a current point, and to derive the curvature 
from the Turning Angle value. The Turning Angle is defined as the angle between the 
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tangent to the track at the current point and a reference axis. Then a term based on the 
curvature value is taken into account for calculating function CC k in order to penalize track 
trajectories that have too many points associated to important curvature values. 

The Filiation Front Marching technique according to the invention provides a front 
5 propagation which is made discrete by using the City Block Distance law which permits 
horizontal or vertical increments of value 1, but it does not provide curvature means of 
calculation means. So, according to the invention, a first-order recursive filter is used to 
calculate a reliable curvature along the First Track. The filiation law, based on the City 
Block Distance, gives the distances DX k , DY* along the lines and the columns, i.e. a the x-axis 
10 and y-axts, between Father P K -i and Child Pk as : 

DX K € [-1, 0, 1] (5A) 
DY K g [-1,0, 1] (5B) 
Diagonal movements are not allowed. So a Turning Angle is obtained by a calculation based 
on the value of the ratio DX / DY. A first Turning Angle is calculated relative to the short 
1 5 past and a second Turning Angle is calculated relative to the long past. As an example, the 
past including 10 Fathers is a short past (SP), the past including 20 Fathers is a long past 
(LP). So, the distances are given by the relations : 

DX SP{K) = £DX K + (1-^) DX S p (K .,) (6A) 

D¥sp ^= ffDY fe +(l P)DXs pq^ (6©> 

20 DYsPfK) -_g DYjc + (1- ■ £) PYspor-n ; (6B) 

Now, taking into account the long past (LP) to calculate the distances : 

DX LP(K) - y DX K + (\-y) DX LW -d (7A) 

m^Kj—roxx + ( i -nm^p^n am 

25 where 0< (3 < y < 1, and 0 and?' are constant parameters. Approximately, =0.1 for 
1 0 Fathers and y = 0.05 for 20 Fathers. From the above relations of DX K and DY K , 6A, 6B, 
7 A, 7B, the Turning Angles are calculated at each point, either taking into account the short 
past SP or the long past LP. These Turning Angles are denoted respectively #sp(k> #lp(k)- 
#sp(fc) = atg ( DY SP( k/DXsp(K)) e [0, tt] (8A) 

30 <9 LP(K) = atg ( DYlp^/DXl^k)) e [0, n ] (8B) 

from which the curvature K K is calculated at the current point by a difference of the two 
Turning Angles relative to short past and long past so as : 
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K K = | &LPIK) ~ 0 S P(K)| (9) 

as illustrated by FIGs 4A, 4B showing the possible relative dispositions of 9 SP(K)? 0 LP(K) 
resulting in different possible values of the difference K K . 

From the curvature Kk, and a new weight W which takes the potential and the 
5 curvature into account and may be, for instance, W - 0,5 \ the cost C fc is provided by the 
following recursive relation : 

CC K - a CC k _, + (\-a ) [Q k + W.KJ (10) 
According to the above relation, CC k is a function of local measures which provide a good 
sensitivity and of global measures which provide substantially smooth paths. The calculation 
10 ofCCic may be carried out by recursive filters for determining the geometry, i.e. A locations, 
and the kinetic, i.e. a speed and acceleration, of the points belonging to a given path. 

Referring to FIG.5, an X-ray medical examination apparatus I 50 comprises employs 
means structure for acquiring digital image data of a medical image, and a digital processing 
system 1 20 for processing these data according to the processing method described above. 
1 5 The X-ray apparatus comprises an X-ray source 1 01 , a table 1 02 for receiving a patient to be 
examined, an optical system 103, 104 for supplying image data to the processing system 120 
which has at least one output 106 to send image data to display and/or storage means 1 07. 
The display and storage m e ans 107may respectively be the screen 1 40 and the memory of a 
workstation 130. Said The s toring mean s storage 107 may alternately be external storing 
20 means to apparatus 150 . This image processing system 1 20 may be a suitably programmed 
computer of the workstation 1 30, or a special purpose processor which has circuit moans a 
circuit configuration, such as LUTs, Memories, Filters, Logic Operators, which are arranged 
to perform the functions of the method steps according to the invention. The workstation 130 
may also comprise employ a keyboard 131 and a mouse 132.employ 
25 White the embodiment s of the invention disclosed herein are presently considered to 

be preferred, various changes an d modifications can be made without departing from the 
spirit and scope of the invention. The scop e o f the invention is indicated in the appended 
claims, and all ch anges that come within the meaning and range of equivalents are intended 
to be embraced therein 



PAGE 31/47 * RCVD AT 2/5/2004 11:41:00 PM [Eastern Standard Time]* SVR:USPTO-EFXRF-1/0* DNIS:8729315 * CSID:317 595 0993 * DURATION (mm-ss): 16-34 



Feb 05 04 ll:51p Darrin Ueslea Harris [317) 5950993 p* 32 

PHF 99.548 

15 11.0 5.2000 

ABSTRACT: 



An image processing method of extracting the points of a path following a threadlike 
structure in an image (IP) formed by a grid of Potential points. ? comprises : a A first 
processing step (4) of p e rforming implements a first path-tracking operation using a front 
5 marching technique denoted Filiation Front Marching Technique (FFM) for supplying at 

least one First Track of the threadlike structure, formed by succeeding points denoted Fathers 
and Children, by marching a Front of points forwards from a fixed Start point (A) to a fixed 
End point (B). 7-eftd-a A second processing step (5) p e rformin g implements a second path- 
tracking operation using said the Filiation Front Marching Technique for supplying a Best 
1 0 Path from one First Track by back propagating the Front starting at the End Point and going 
through already determined Children and Fathers until the Start Point is reached. An X ray 
apparatus- is propo s ed, having m e ans for carrying out said method of improv i ng the 
visualizat i on of cath e t e r guid e wir e . 

Application : Medical Imaging ; X ray Apparatus. 
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IMAGE PROCESSING METHOD AND SYSTEM, AND MEDICAL EXAMINATION 
APPARATUS, FOR EXTRACTING A PATH FOLLOWING A THREADLIKE 

STRUCTURE IN AN IMAGE 



FIELD OF THE INVENTION 

The invention relates to an image processing method of extracting the points of a path 
following a threadlike structure represented in an image. The invention more particularly 
relates to an image processing method of extracting the points representing a catheter guide- 
5 wire in an X-ray fluoroscopic medical image or thin vessels in an angiogram. The invention 
also relates to an image processing system and to a medical examination apparatus such as an 
X-ray apparatus having a system for image processing. 

The invention is applied to medical imaging systems and to the industry of X-ray 
medical examination apparatus. 

10 

BACKGROUND OF THE INVENTION 

A method to determine an object contour, referred to as minimal path, between two 
fixed end points in a 2-D image, is disclosed in the publication "Global Minimum for Active 
Contour Models: A minimal Path Approach" by Laurent D. COHEN and Ron KIM MEL, in 

1 5 International Journal of Computer Vision 24( I), 57-78 ( 1 997). This method proposes a 

technique of boundary detection of objects for shape modeling in 2-D images. This method 
particularly aims at solving the boundary detection problem by mapping it into a global 
minimum problem and by determining a path of minimal length from the solution of that 
global minimum problem. The method guarantees that a global minimum of energy is found 

20 by minimizing curves between two end points. This method implements a step of (1 ) 

manually selecting a start point and an end point in an object contour region of a gradient 
image, (2) a step of propagating a front, in the totality of the gradient image, starting at the 
start point, in such manner that this front propagates at lower cost in regions of high gradient 
values until the end point is reached to thereby determine a cost map that is a totally convex 

25 surface having a single minimum and (3) a step of back-propagating from the end point 
towards the start point by the steepest gradient descent in the totally convex surface to 
thereby provide a minimal path between the start and end points. 

This publication includes by reference a front propagation technique disclosed in a 
publication entitled "A fast marching level set method for monotonically advancing fronts 1 ' 
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by J. A. SETHIAN in Proc. Nat. Acad. Sci., USA, Vol. 93, pp. 1591-1595, February 
1996, Applied Mathematics. According to the reference, a front, formed in a 2-D grid of 
potential values, is propagated using a "Fast Marching Technique" with a determination of 
the front points. The front is a solution of a so-called Eikonal Equation. The Fast Marching 
5 Technique introduces order in the selection of the grid points and sweeps the front ahead in 
one pass on the 2-D image. The Fast Marching Technique implements a marching of the 
Front outwards by freezing already visited points denoted Alive, coming from a set of points 
referred to as Narrow Band, and by bringing new ones denoted Far Away into the Narrow 
Band The Narrow Band grid points are always updated as those having minimal potential 
10 values in a neighboring structure denoted Min-Heap and the potential of the neighbors are 
further re-adj usted. 

The method known from COHEN's publication constructs the convex surface of the 
cost map using the Fast Marching technique, which provides respectively one path of 
minimal cost joining the start point to each respective point of the front, the front propagating 
1 5 until the end point is reached. Then, the minimal path is provided by back-propagating from 
the end point to the start point by the steepest gradient descent in the convex surface. The 
numerous paths constructed by propagating the front forwards and joining the start point to 
the different points of the front for forming the convex surface are no longer taken into 
account. Even the path joining the start point to the end point, in the operation of forwarding 
20 the front, is not the steepest gradient descent in the back-propagation operation. 

So, the final path obtained by this known method does not have points extracted by 
tracking. Neither does it have points of a path constructed by front propagation. 

Besides, it is interesting to note that the points of a path constructed in the operation 
of marching the front forwards are points which have the smal lest possible potentials. 
Starting at the start point, and going forwards from one point to the next point must be at the 
"minimal cost". So, such a path is a path of ''minimal Action", i.e., a path on which the 
"Sum" or the "Integral" of potentials calculated over point potentials is the smallest, though 
strictly continuously growing as a function of the number of points present on the path 
between the start point and the current point on the front 

A first problem in extracting a threadlike structure is that the threadlike structure may 
be represented in the original image by a number of thin linear segments which are not joined 
in a strictly continuous manner, having "holes" between them, and which are to be found 
among a great number of other thin unrelated structures, referred to as false alarms. A 
second problem is that the threadlike structure may be very long and sinuous, so that it may 



25 



30 
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be far from a straight line and may even present U-turns along its length, and that it may be 
formed by a great number of points. 

On the one hand, a path constructed using the front propagation technique described 
in the known publication is not adapted to solve these problems, due to the fact that the front 
5 propagation is based on an "Action", i.e., a "Sum" of potentials effectuated along the 

constructed path. Because the threadlike structure is very long, this Sum of potentials will 
soon become very large on a path following the threadlike structure. When the Sum becomes 
large, the cost becomes high, and, for minimizing costs, the known front marching technique 
may generate a path based on the nearest false alarms in order to follow as few points as 
10 possible. So, the known front marching technique may generate a path which is far from 
following the sinuous and long threadlike structure. 

On the other hand, the minimal path obtained by the above described minimal path 
method is a smoothed path, which may not possibly provide extracted points strictly 
following a long and sinuous threadlike structure. 

15 

SUMMARY OF THE INVENTION 

The present invention has for an object to provide an automatic image processing 
method performed between two predetermined end points for supplying a path strictly 
following a long sinuous threadlike structure. The invention particularly has for its object to 

20 provide such a method of processing an original image of such a long and sinuous ill- 
represented threadlike structure and of false alarms and to provide extracted points of the 
threadlike structure as a continuous linear structure of points denoted path, suitable for 
improving the visualization of the threadlike structure. 

It is also an object of the invention to provide a medical examination apparatus using 

25 an image processing system to carry out this method and to process medical images. 

Advantages of the method are that it is automatic, robust and reliable, it accurately 
and securely follows the long sinuous threadlike structure without looking for a shorter path 
and without providing holes and false alarms, it is less calculation-time consuming than the 
known front marching technique, it may be applied to construct 3-D images from 2-D data 

30 and it is implemented with simple structural configurations. An advantage of the apparatus is 
that the visualization is improved of thin long structures in a medical image, such as a guide- 
wire in an angiography image for instance, or brain vessels. 



BRIEF DESCRIPTION OF THE DRAWINGS 



PACE 35/47 * RCVD AT 2/512004 11:41:00 PM [Eastern Standard Time]* SVR:U SPTO-EFXRF- 1/0 * DNIS:8729315 * CSID:317 595 0993 * DURATION (mm-ss): 16-34 



Feb 05 04 1 1 : 52p Darrin Uesley Harris (317] 595-0993 p.3G 

PHF 99.548 

4 

The invention is described hereafter in detail with reference to diagrammatic figured, 
wherein: 

FIG. I is a functional block diagram illustrating the main steps of the path-tracking 
method; 

5 FIGS- 2A to 2C illustrate the front propagation according to the Filiation Front 

Marching technique in a grid of points; 

FIG. 3 is a curve of the weight to be assigned to each potential as a function of a 
number of points along the track determined by the Filiation Front Marching technique from 
the Ancestor or Start Point to the last found Child or current point; 
10 FIGS. 4A and 4B illustrate the calculation of the turning angle at a point of the track 

for determining the curvature of the path; and 

FIG. 5 illustrate an X-ray apparatus having a system for carrying out the method. 



DESCRIPTION OF PREFERRED EMBODIMENTS 

1 5 The invention first relates to an image processing method based on a path-tracking 

operation performed between two fixed end points for supplying a path strictly following a 
long sinuous threadlike structure represented on a background in a digital image. In 
particular, the invention relates to an image processing method of path-tracking the points 
representing a catheter guide-wire in an X-ray fluoroscopy medical image. In another 

20 particular application, the invention may relate to the path-tracking of thin brain vessels 
which have a threadlike shape. The invention also relates to a system implementing the 
method and to an X-ray medical examination apparatus having such a system for image 
processing and image visualization. 

In the first particular case of guide-wire path-tracking, the medical image may be an 

25 X-ray static arteriogram image representing at least a blood vessel with a guide-wire. In 

cardiology, such an image may be used to present medical data related to the blood vessel for 
farther medical procedures. The medical procedures using catheter deeply rely on the correct 
visibility of the guide-wire which is a metallic wire introduced in the vessel for guiding the 
catheter. An image processing operation of path-tracking this guide-wire in an arteriogram 

30 image, that is the detection and location of the points belonging to the guide-wire, can serve 
several highly interesting purposes. For example, a binary extraction mask may be 
constructed from the path-tracking operation thus increasing visibility, in order to improve 
the practitioner's ability to determine medical data. After a complete extraction of the guide- 
wire points, the guide-wire tip can be located and an area of interest may be defined around 
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this tip. This enables further local processing for better visibility enhancement of a tool 
called stent introduced in the vessel for its enlargement. In the second particular case, the 
medical image may be an angiogram of the brain where the vessels have been made as visible 
as possible by injection of a contrast fluid into the patient. The brain angiogram contains 
5 very thin vessels which may be very difficult to visualize. The method according to the 

invention permits the practitioner to better visualize the vessels. In both cases, the data may 
alternately be used to construct 3-D images. 

The present path-tracking operation uses a Front Marching technique referred to 
herein as Filiation Front Marching technique denoted FFM, which is not based on a "Sum" or 

1 0 an "Integral of potentials" to go from one point to another, as known from the state of the art, 
but which instead is based on terms of "Weighted Sums of Potentials". It is to be noted that 
the "Weighted Sums of Potentials" correspond to calculated terms of "Cumulated Costs", 
which may not be growing strictly continuously. This property of strictly continuous 
growing, which exists in the terms of "Sums" or "Integrals" of the Prior Art technique, no 

1 5 longer exists in the terms of "Cumulated Costs" of the present path-tracking operation. So, 
according to the present Filiation Front Marching technique, the result is that the property of 
relying on the construction of a minimal path no longer exists. Actually, the path tracking 
operation based on the FFM technique aims at providing a "Best Path which is not bound to 
be the "Minimal Path". The "Best Path" is defined as the path that is validated by using the 

20 FFM technique described hereafter. 

Now, the FFM technique first implements a definition of a function of Cumulated 
Costs associated to each processed point, which is based on the Potentials of the processed 
points and which is especially adapted to path-tracking long sinuous threadlike structures. 
Such a function formed by terms of Cumulated Costs is no longer strictly growing, thus the 

25 cost map which may be constructed from these terms of Cumulated Costs is no longer 
exactly convex, and the required path is no longer allowed to be obtained by the simple 
steepest descent from the End point to the Start point. Using this function of Cumulated 
Costs, the Best Path found may not be minimal. Moreover, this FFM technique is not based 
on the known Eikonal Equation used in the prior art, but, instead, is based on a specific 

30 "Distance" for defining a distance relationship establishing a direct filiation between 
consecutive points which belong to a path and which are denoted "Father and Child". 

The path-tracking operation using the FFM technique implements an initializing 
phase of setting end points for the required Best Path, denoted Start and End Points, which 
are defined in an image of Potentials. Using the relation of direct filiation, in a first 
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processing phase of the technique, the front is marched forwards, starting from the Start Point 
which is referred to as the "Ancestor", until it reaches the End Point which is referred to as 
the "Last Child". Then, in a second processing phase of the technique, the required Best Path 
is found by tracking backwards from the Last Child to the Ancestor, 
5 Referring to FIG. 1, which is a functional block diagram illustrating the image 

processing method for path-tracking a threadlike structure based on the FFM technique, the 
method implements the following operations. 

An operation 1 of image data acquisition from an Original Image denoted OI, for 
instance a medical image such as a cardiogram including a guide-wire or an angiogram 

10 including thin vessels to be extracted; the image data include digital intensity levels referred 
to as pixel values, and pixel coordinates in the Original Image. 

An operation 2 of construction of a contrast image IP in which each pixel of the 
Original Image is associated to a new calculated intensity level which is taken as a Potential; 
such an operation may be carried out by any technique known to those skilled in the art for 

15 enhancing troughs in the Original Image: for instance, in the cited medical Original Image 
OI, the objects of interest, either guide-wire or opacified vessels, are darker than the 
background; so, the Original Image OI is first inverted, then the ridgeness is evaluated by a 
filtering operation: by this filtering operation, for example, the maximum curvature is 
calculated at each current point as a differential invariant by passing a Gaussian filter then a 

20 differential operator, thus providing enhanced ridges in the places of the objects of interest; 
the filtered image is further again inverted to provide an image referred to as " Image of 
Potentials" which is the contrast image IP, where the objects of interest are again darker than 
the background and form thin troughs substantially contrasting with the background. 
An initializing phase 3 of setting end points including a Start point A denoted 

25 Ancestor and an End point B denoted Last Child between which a path following a given 
object of interest, that is the threadlike object, is to be determined in the contrast image IP. 

A first processing phase 4 of path-tracking using the front propagation technique 
referred to as the FFM technique, to march a Front forwards from the Start Point A to the 
End Point B; in the first processing phase 4, marching the Front forwards according to the 

30 FFM technique provides First Tracks for the path. 

A second processing phase 5 of path-tracking also using the FFM technique, starting 
at the End Point B considered as the last born Child and propagating the front backwards 
thus following one First Track backwards; in order to come down the First Track, it is 
necessary and sufficient to follow the filiation from Child to Father and Grandfather until the 
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Ancestor which is the Start point A is reached; it is different from going down the steepest 
gradient descent of the known convex cost map; the required Best Path is obtained in this 
second processing phase 5 by the backtracking operation. 

Using the FFM technique, the first processing phase 4 of marching the Front forwards 
5 has the advantage of not being time consuming because the Front is not wide and does not try 
many solutions. The second processing phase 5 has the advantage to provide the required 
Best Path having no holes, including no false alarms and strictly following the threadlike 
structure. The description of this FFM technique includes first a description of the front 
construction technique, then a detailed description of the function of terms of Cumulated 
10 Costs. 

Referring to FIG. 2A to FIG. 2C, the Front according to the FFM technique is 
constructed in an iterative manner. FIG. 2A to FIG. 2C each represents a grid of points in the 
Image of Potentials IP constructed in the operation 2 from the Original Image acquired in the 
operation 1 . This Image of Potentials contains the two End Points set in the initializing phase 
15 3, including the Start Point A and the End Point B. An advantageous specific Distance law to 
be used in this FFM technique is based on the known City Block Distance. The Distance 
law permits of propagating, on a path constructed by the FFM technique, only along lines or 
columns of the grid of points, with one grid point interval between two successive points 
referred to as Father and Child. Also, an advantageous Criterion of costs, which will be 
20 further described, provides a function of Cumulated Costs related to a point of the grid called 
Child, the Criterion taking into account a function of the Cumulated Costs related to the 
Father of this Child and of the Potential at this Child. 

Referring to FIG. 2A, at a certain stage of the front propagation denoted instant tO, the 
Image of Potentials IP comprises points already visited which are referred to as Frozen 
25 Points, located in a zone denoted FZ, and which are represented by dots. These Frozen 

Points are not allowed to change state, that is to have the name of their location FZ or their 
associated function of Cumulated Costs modified. This is the reason why they are referred to 
as Frozen Points. The already propagated front is a set of points including the Start Point A 
which is the Ancestor and Frozen points forming paths going to the last Frozen Points found 
before the instant tO. This Frozen zone has an outwards boundary referred to as LOFZ. The 
interior of the Frozen zone FZ are points labeled Frozen Points and having only neighbors 
labeled Frozen Points. 

Besides the Frozen Points, the image of Potentials IP implements points which are 
situated in a zone denoted NB, adjacent the Frozen zone, referred to as Narrow Band whose 



30 
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points are represented by crosses. This Narrow Band surrounds the Frozen zone external 
boundary and has itself a further external boundary denoted LONB. So, the external 
boundary LOFZ of the Frozen zone is a set of points labeled Frozen Points having at least one 
neighbor labeled Narrow Band Point. 
5 The Image of Potentials IP moreover implements points referred to as Far Points 

represented by small squares, located in a zone denoted FAR, which includes ail points 
external to the Narrow Band and the Frozen zone. So, the externa] boundary LONB of the 
Narrow Band is a set of points labeled Narrow Band Points having at least one neighbor 
labeled FAR Point. 

10 According to this FFM technique, an operation of examining a point of the Narrow 

Band, considered a Child, is performed. The Father of this point must be a point of the 
Frozen zone which is a neighbor of the Child and which is such that the function of 
Cumulated Costs related to the Child associated to the Father is minimal with respect of 
other functions of Cumulated Costs which may be calculated for the Child associated to 
15 other possible Fathers. For instance, in the example of FIG. 2 A, a part of the grid of points is 
examined. This grid part comprises at this given instant tO : 

Points P|, P 2 , P 3 , P 6 which are in the Frozen zone F2 ; 
Points P 9 > P 4 , Ps which are in the Narrow Band NB ; 
Points P 7 , Ps which are in the Far zone FAR. 
20 These points of the grid are examined and, in the example of FIG. 2A, current point P 5 is 
found to present two properties: It is located in the Narrow Band and its function of 
Cumulated Costs, calculated according to the Criterion which will be further described, is 
minimal with respect to those of the other points of the Narrow Band. The current point P s is 
then selected as the Narrow Band point having the minimal function of Cumulated Costs at 
25 this instant tO. According to this FFM technique, the current point P 5 having such properties 
is decreed a possible Father. 

Referring to FIG. 2B, at the next instant tl , in the Image of Potential IP, the state of 
this current point P 5 is modified by marching the limit LOFZ of the Frozen zone towards the 
Narrow Band zone so as to include point P 5 in the Frozen zone. The limit is now referred to 
30 as L1FZ. Further on, the point P 5 is a Frozen point having the function of Cumulated Costs 
previously determined and is referred to as a Father. Now, according to this FFM technique, 
it is looked for the only Chifd of this Father. 

Referring to FIG. 2C, at the instant t2 following tl, in the image of Potentials IP, the 
neighbors of the Father Point P 5 are examined. According to the Distance law of the FFM 
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technique, only adjacent points on lines and columns may be neighbors and, unlike the 
method cited as prior art, the diagonal points are not relevant and are thus not considered. 
So, according to the Distance law of the FFM technique, in the case illustrated by FIG. 2C as 
an example, there are four existing neighbors, which are P 8 , P*, P 6 , p 2 _ All neighbors must be 
5 examined and possibly updated. Their state may be modified, i.e., some of them may 
become Children: 

Neighbors Pe, P2 are in FZ. They remain Frozen Points. 
Neighbor P 8 is in FAR. At this instant 12, the limit of the NB zone is marched 
towards the FAR zone so as to include this neighbor P 8 in the Narrow Band zone according 

10 to a new limit L2NB of the Narrow Band, thus filing the hole created in the Narrow Band at 
the previous instant tl by marching the Frozen Zone limit forwards to reach the location 
LI FZ. The Narrow Band preferably does not remain with a hole. A.t this instant t2, point P s 
in the Narrow Band becomes a Child whose Father has to be determined. 

Still referring to FIG. 2C, at the instant t3, the Father and the Cumulated Cost of this 

1 5 new Child P 8 are determined. The Father of the Child P 8 must be the neighbor which is 

already located in FZ and which has the smallest related function of Cumulated Costs. Only 
point P 5 answers these conditions because it has been selected as having the smallest function 
of Cumulated Costs according to the result of the calculation of the Criterion as explained in 
relation to FIG. 2B. So this Frozen Point P 5 may be decreed to be the Father of Child P 8 . 

20 Now, a new function of Cumulated Costs is to be calculated for this Child P 8 from the 

further described Criterion, which takes into account the function of Cumulated Cost of the 
Father P 5 and the Potential at the Child. 

Neighbor P 4 is in NB. It remains in NB. Until instant t3 this point P 4 of the Narrow 
Band has had a Father and a related function of Cumulated Costs which have been 

25 determined at a given previous instant. Let this previous function of Cumulated Costs be 
denoted CC) and this previous Father be for example Pt of the Frozen zone FZ. For 
searching the Father of this Child P 4 , the points located in the Far zone are not relevant 
points, the points having infinite costs. Point P 2 is in a diagonal position with respect to 
Child P 4 , so P 2 is not relevant. Thus, only P, and P 5 may be possible Fathers. 

30 At the following instant t4, it is investigated whether the point P 5 may be a better 

Father for its neighbor P 4 than the previous Father P, of the Child point P 4 of the Narrow 
Band. To that end, a new function of Cumulated Costs denoted CC 2 is calculated for this 
Child P 4 , taking into account that this point P 5 may be a Father of P 4 . For that purpose, this 
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new CC 2 takes into account the function of Cumulated Costs related to the possible Father P 5 
and the Potential at the Child R*. Then CQ and CC2 are compared. 

When CC 2 > CC U it means that it is not interesting to make the required path pass 
through possible Father P 3 . So point P 5 is not decreed the Father of P4. 
5 When CC 2 < CCi 7 it is interesting to make the required path pass through Father P 5 , 

so the point P5 may be decreed the new Father of the neighbor P 4 instead of Pi and CC2 is 
the new function of Cumulated Cost related to the Child P4 associated to the Father P5. 

The Criterion giving the function of Cumulated Costs CC k related to a given current 
point P k is a function of the sum of the minimum among the Cumulated Costs of the 

10 neighbors of the current point P k and the Potential at the point. According to the present 
FFM technique, since the cost related to the current point is calculated from the Minimum 
"Min" of a number of Cumulated Costs constituted by the Cumulated Costs of its neighbors 
located at one grid interval on the same line or column, the Argument "Arg" of the minimum 
"Min" supplies the location of the point referred to as "Father" of the current point P k which 

1 5 is the last one to go out of the Narrow Band. 

The Father of the current point P k is the last point to go out of the Narrow Band in 
order to become a Frozen Point. The next FAR Point becomes a Narrow Band Point. This 
former FAR point had an infinite Cost. It must be attributed a new function of Cumulated 
Cost. The point that is the last one to go out of the Narrow Band gives its function of 

20 Cumulated Cost to its neighbor FAR Point and becomes its possible Father. 

The function of Cumulated Cost CC k may preferably be determined by the Criterion 
described hereafter providing a robust and reliable value. This Criterion is described in two 
examples of Techniques referred to as CC k First Calculation Technique and CCic Second 
Calculation Technique, which is a refined version of the First Calculation Technique. 

25 * The First Calculation Technique to compute CC k takes into account that the track 

between the Ancestor and the current point must have on average the lowest Potential value. 
So this First Technique involves a Potential Mean Value instead of the Potential Sum or 
Integral known from the State of the Art. According to the Filiation Front Marching 
Technique, the length of the path between the Ancestor and the current point is calculated by 

30 adding 1 each time a Father fathoms a Child. When the Father is located at the above- 

described City Block Distance denoted Distance L k from the Ancestor, the Child P* is located 
at a Distance U+l which may be written as L k+1 . So, the Distances between the Ancestor 
and the current points are updated, and the CCk values are further calculated as follows as a 
Potential Mean Value (1) : 
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CC fc =Tf-2Qi (1) 

where Q are the Potentials at the current points located between the Ancestor and point P k . 
The previous relation (I) may be written as: 
_ (CC t , l )(L k , [ ) + Q k 

- - (2) 

k 

5 Thus, each time a Child is fathomed, the Distance is updated by adding 1, and the new 

function of Cumulated Cost is calculated from the previous function of Cumulated Cost, the 
previous Potential and the previous Distance. Unlike the law known from the State of the Art 
where the paths are associated to the smallest ^]Q k , which penalizes the long threadlike 
structures, according to the invention the paths are associated to the smallest Q K which 
10 favors the long threadlike structures. 

Referring to FIG. 3 7 which shows a curve of CC k versus the potential Q k where k is 
the number of points on the path starting from the Ancestor, it is to be noted that the function 
CC K is weighted by a constant weight having the value 1/L k . Unlike the State of the Art, 
where the £Q k which is used as weighted by a weight 1, according to the invention the 
1 5 fimction CC k is weighted by the term 1/L k , which depends on length and makes an 

advantageous correction of the function evaluation. The Distance L K is the aboveniescribed 
City Block Distance. However, it is to be noted that in relation (2) the potential Q k has only a 
small influence on the CC K value which is a cause of lack of sensitivity to local Potential 
variations. An advantage is that the sensitivity of the path tracking technique is substantially 
20 independent of the path length. 

According to the invention, in this First Calculation Technique, the function CC k is 
evaluated using first order recursive filters which supply the required Weighted Sum (2). 

A second Calculation Technique is described hereafter for solving the problem of 
lack of sensitivity. Now, in the Second Calculation Technique, the function CC k is 
25 calculated using an average effected of predetermined limited temporal spans defined from 
the current point, which permits, as the path is progressively constructed, to progressively 
"forget" the data related to points processed prior to the temporal spans. So, this Technique 
permits to take Local Events in a given past into account. 

For calculating the function CC k , the track is searched first only locally in the best 
30 possible direction, taking the Local Events into account. To that end, only the functions of 
Cumulated Cost related to the points found in a given past are taken into account for 
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calculating the function CCk, while the functions of Cumulated Cost related to points which 
where found in a longer past are "forgotten", i.e., they are not taken into account. This is 
obtained using one parameter cc which is a weight factor of minimization of the influence of 
points situated farther away than at a given distance from the current point. This weight 
5 factor is applied to the previously described function of Cumulated Costs, where CCk-i is the 
function of Cumulated Cost related to the Father and Q K is the Potential at the current point : 

CC K =^C K _,+(l-a)Q K (3) 
The a parameter is a constant and fixes the temporal span, and the number of Fathers which 
is taken into account. The span may be approximated by the relation : 

10 where 0 < cc < 1. (4) 

If a - 0.9, the number of Fathers which is taken into account to calculate CC k is about 10. 
If a - 0.5, the number of Fathers which is taken into account to calculate CC k is about 20. 

Now, it is not sufficient to take Local Events into account, because the Filiation Front 
Marching technique may be deceived and may lose the good track. So Global Events must 

1 5 also be taken into account. To that end, the Filiation Front Marching technique takes into 
account the curvature along the First Track in order to avoid zigzags. It is known to those 
skilled in the art to calculate the Turning Angle at a current point, and to derive the curvature 
from the Turning Angle value. The Turning Angle is defined as the angle between the 
tangent to the track at the current point and a reference axis. Then a term based on the 

20 curvature value is taken into account for calculating function CC k in order to penalize track 
trajectories that have too many points associated to important curvature values. 

The Filiation Front Marching technique according to the invention provides a front 
propagation which is made discrete by using the City Block Distance law which permits 
horizontal or vertical increments of value 1* but it does not provide curvature means of 

25 calculation means. So, according to the invention, a first-order recursive filter is used to 
calculate a reliable curvature along the First Track. The filiation law, based on the City 
Block Distance, gives the distances DX t , DY k along the lines and the columns, i.e., the x-axis 
and y-axis, between Father P K -i and Child as : 

DX K e [-1, 0, 1] (5A) 

30 DY K €[-1,0,1] (5B) 

Diagonal movements are not allowed. So a Turning Angle is obtained by a calculation based 
on the value of the ratio DX / DY. A first Turning Angle is calculated relative to the short 
past and a second Turning Angle is calculated relative to the long past. As an example, the 
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past including 1 0 Fathers is a short past (SP), the past including 20 Fathers is a long past 

(LP). So, the distances are given by the relations : 

DX SP()Q = pDX K + (1-/?) DXsFut-i) (6 A) 

DY SP( K) = P DY K + ( 1 - P ) DY SP (K-i ) (6B) 
5 Now, taking into account the long past (LP) to calculate the distances : 

DX LP(K) = yDX K + (l-y)DX LPiK - l} (7A) 
DYuw = /DY K + 0-r ) DY^k,) (7B) 

where 0< ft < y < 1,and P and/ are constant parameters. Approximately, p =0.1 for 

10 Fathers and y = 0.05 for 20 Fathers. From the above relations of DX K and DYkl, 6A, 6B, 
10 7A, 7B, the Turning Angles are calculated at each point, either taking into account the short 

past SP or the long past LP. These Turning Angles are denoted respectively # SP (k:> #lp(k> 
#sp(k:) = atg ( DYs^k/DXs^k)) <= [0, n ] (8 A) 

0 lpck) = atg ( DY lp(K )/DXlp(K)) e [0, x ] (8B) 

from which the curvature FC K is calculated at the current point by a difference of the two 
1 5 Turning Angles relative to short past and long past so as : 

Kit = | #LP(K) " #SP(K)| (9) 

as illustrated by FIGs 4A, 4B showing the possible relative dispositions of <9 SP(K> , #lp(K) 
resulting in different possible values of the difference Kk- 

From the curvature K k , and a new weight W which takes the potential and the 
20 curvature into account and may be, for instance, W = 0,5, the cost C k is provided by the 
following recursive relation : 

CC K = a CC k .i + (l-a ) [Qk + W.KJ (1 0) 

According to the above relation, CC k is a function of local measures which provide a good 
sensitivity and of global measures which provide substantially smooth paths. The calculation 
25 of CC K may be carried out by recursive filters for determining the geometry, i.e., locations, 
and the kinetic, i.e., speed and acceleration, of the points belonging to a given path. 

Referring to FIG. 5, an X-ray medical\xamination apparatus 1 50 employs structure 
for acquiring digital image data of a medical imWe, and a digital processing system 120 for 
processing these data according to the proccssingViethod described above. The X-ray 
30 apparatus comprises an X-ray source 1 0 1 , a table 1 02 for receiving a patient to be examined, 
an optical system 103, 104 for supplying image data to the processing system 120 which has 
at least one output 106 to send image data to display arid/or storage 107- The display and 
storage 107 may respectively be the screen 140 and the rf kemory of a workstation 130. The 
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storage 107 may alternately be external to apparatus 150 . This image processing system 120 
may be a suitably programmed computer of tha workstation 130, or a special purpose 
processor which has a circuit configuration , such as LUTs, Memories, Filters, Logic 
v ^\ Operators, which are arranged to perform the fuifctions of the method steps according to the 

5 invention. The workstation 130 may also employ\a keyboard 131 and a mouse 132.employ 
While the embodiments of the invention disclosed herein are presently considered to 
be preferred, various changes and modifications can be made without departing from the 
spirit and scope of the invention. The scope of the invention is indicated in the appended 
claims, and all changes that come within the meaning and range of equivalents are intended 
10 to be embraced therein. 
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ABSTRACT: 



An image processing method of extracting the points of a path following a threadlike 
structure in an image (IP) formed by a grid of Potential points. A first processing step (4) 
implements a first path-tracking operation using a front marching technique denoted Filiation 
5 Front Marching Technique (FFM) for supplying at least one First Track of the threadlike 

structure, formed by succeeding points denoted Fathers and Children, by marching a Front of 
points forwards from a fixed Start point (A) to a fixed End point (B). A second processing 
step (5) implements a second path-tracking operation using the Filiation Front Marching 
Technique for supplying a Best Path from one First Track by back propagating the Front 
1 0 starting at the End Point and going through already determined Children and Fathers until the 
Start Point is reached. 
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